Evaluation of telehealth administration of MMPI symptom validity scales.

INTRODUCTION: Telehealth assessment (TA) is a quickly emerging practice, offered with increasing frequency across many different clinical contexts. TA is also well-received by most patients, and there are numerous guidelines and training opportunities which can support effective telehealth practice. Although there are extensive recommended practices, these guidelines have rarely been evaluated empirically, particularly on personality measures. While existing research is limited, it does generally support the idea that TA and in-person assessment (IA) produce fairly equitable test scores. The MMPI-3, a recently released and highly popular personality and psychopathology measure has been the subject of several of those experimental or student (non-client) based studies; however, no study to date has evaluated these trends within a clinical sample. This study empirically tests for differences in TA and IA test scores on the MMPI-3 validity scores when following recommended administration procedures. METHOD: Data were from a retrospective chart review. Veterans (n = 550) who underwent psychological assessment in a Veterans Affairs Medical Center ADHD evaluation clinic were contrasted between in person and telehealth assessment modalities on the MMPI-2-RF and MMPI-3. Groups were compared using t tests, chi square, and base rates. RESULTS: Results suggest that there were minimal differences in elevation rates or mean scores across modality, supporting the use of TA. CONCLUSIONS: This study's findings support the use of the MMPI via TA with ADHD evaluations, Veterans, and in neuro/psychological evaluation settings more generally. Observed elevation rates and mean scores of this study were notably different from those seen in other VA service clinics sampled nationally, which is an area of future investigation.

Internalizing and externalizing comorbidity and symptom burden in a VA ADHD specialty evaluation clinic.

The purpose of this study was to evaluate psychiatric diagnosis and symptom comorbidity in veterans diagnosed with attention-deficit/hyperactivity disorder (ADHD). Study design was retrospective chart review from an ADHD evaluation clinic at a Veterans Affairs hospital. Participants were 227 military veterans who completed a standardized ADHD assessment and produced valid Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) profiles. There were no differences in rates of internalizing or externalizing psychiatric conditions diagnosed in inattentive compared to combined ADHD presentations. However, compared to a subsample with no psychiatric diagnoses, individuals diagnosed with ADHD endorsed significantly more internalizing symptom burden, with combined ADHD veterans also endorsing significantly greater levels of negative emotions and neuroticism. Base rates of comorbid classes of psychiatric diagnoses were not increased in individuals with ADHD, though higher rates of trauma disorders were seen in the combined group compared to the inattentive group. Multivariate base rates of MMPI-2-RF Restructured Clinical scales across various subgroups are presented. There was evidence for differential phenotypes of psychiatric symptoms across ADHD presentations in clinically referred veterans, predominantly related to higher rates of internalizing symptoms.

Symptom burden, validity, and cognitive performance in Iraq and Afghanistan veterans.

INTRODUCTION: The present study evaluates the complex relationships between symptom burden, validity, and cognition in a sample of Iraq and Afghanistan veterans to identify key characteristic symptoms and validity measures driving cognitive performance. We hypothesized that symptom and performance validity would account for poorer outcomes on cognitive performance beyond psychological symptoms. METHODS: Veterans (n = 226) completed a cognitive test battery, Personality Assessment Inventory (PAI), Word Memory Test (WMT), and Miller Forensic Assessment Symptom Test (M-FAST). Partial least squares structural equation modeling (PLS-SEM) modeled the fully-adjusted relationships among PAI subscales, validity, and cognitive performance. RESULTS: 23.45% of participants failed validity indices (19.9% WMT; 7.1% M-FAST). PLS-SEM indicated PAI subscales were not directly associated with performance or symptom validity measures, and there were no direct effects between validity performance and cognitive performance. Several PAI subscales were directly associated with measures of verbal abstraction, visual processing, and verbal learning and memory. CONCLUSION: Contrary to hypotheses, symptom and performance validity did not account for poorer outcomes on cognitive performance beyond symptom burden in the PLS-SEM model. Results highlight the association between psychiatric symptoms and cognitive performance beyond validity status.

Improvement of postinpatient psychiatric follow-up for veterans using telehealth.

PURPOSE: To describe the implementation and initial outcomes of a pilot interdisciplinary telehealth clinic, Allied Transitional Telehealth Encounters post-iNpatient Discharge (ATTEND), providing clinical pharmacy specialist follow-up for veterans transitioning from inpatient to outpatient mental healthcare in a Department of Veterans Affairs (DVA) hospital. SUMMARY: The ATTEND clinic's primary intervention was providing medication management appointments through clinical video telehealth (CVT) to patient discharge locations through a DVA-provided tablet. An interdisciplinary team supported care through on-unit inpatient training, secure messaging, and self-help applications. Clinical outcomes were measured through readmission rates, wait times, self-report measures, and follow-up interview at the completion of ATTEND services. Twenty patients completed on-unit training, and 16 unique patients were seen for at least 1 outpatient appointment. Inpatient readmission rates were lower for ATTEND patients than with standard care (5% versus 19%, respectively). Wait times until first postdischarge mental health appointment were reduced by a mean of 18.6 (S.D., 8.8) days. The pharmacist made medication interventions, including dosing changes, education on incorrect administration, and medication discontinuation. Self-reported psychological symptoms decreased during ATTEND participation. Post-ATTEND interviews indicated high levels of acceptance and interest in continued tablet-based care. Primary challenges included unique technological limitations and effective care coordination. CONCLUSION: The ATTEND telehealth clinic provided postinpatient mental health follow-up that was more prompt and convenient than conventional on-site appointments. Psychiatric self-report improved during ATTEND-facilitated transition to outpatient care, and the recidivism rate for ATTEND patients was lower than the general inpatient rate during the same time period.

Comparability of iPad and Web-Based NIH Toolbox Cognitive Battery Administration in Veterans.

OBJECTIVE: The purpose of this study was to evaluate the comparability of National Institutes of Health Toolbox Cognitive Battery test scores across iPad application and web-based personal computer administration platforms. Original test norms were developed using a personal computer-based administration and no previous studies assessing platform comparability have been published. METHOD: Participants (N = 62; final analyzed sample n = 49) were combat-exposed post-deployment veterans without neurologic disorder, severe mental illness, current substance use disorder, or a history of moderate or severe traumatic brain injury. All participants completed both iPad and web-based versions of tests on the same day in an experimental within-subjects crossover design. Standalone validity measures were incorporated to exclude invalid performance. Outcome measures included the Dimensional Change Card Sort Test, Flanker Inhibitory Control and Attention Test, List Sorting Working Memory Test, and Pattern Comparison Processing Speed Test. RESULTS: Score differences between platforms were found on the Flanker Inhibitory Control and Attention Test. Scores were moderately correlated across tests, with the exception of low correlations for the Pattern Comparison Processing Speed Test. Most participants preferred iPad to web administration, regardless of administration order. CONCLUSIONS: Results suggest caution when interpreting iPad-acquired scores, particularly for the Flanker Inhibitory Control and Attention Test. iPad-based testing offers valuable improvements; however, the development of iPad-specific norms may be necessary to ensure valid interpretation of acquired data.

Telehealth Interventions Designed for Women: an Evidence Map.

BACKGROUND: Telehealth employs technology to connect patients to the right healthcare resources at the right time. Women are high utilizers of healthcare with gender-specific health issues that may benefit from the convenience and personalization of telehealth. Thus, we produced an evidence map describing the quantity, distribution, and characteristics of evidence assessing the effectiveness of telehealth services designed for women. METHODS: We searched MEDLINE® (via PubMed®) and Embase® from inception through March 20, 2018. We screened systematic reviews (SRs), randomized trials, and quasi-experimental studies using predetermined eligibility criteria. Articles meeting inclusion criteria were identified for data abstraction. To assess emerging trends, we also conducted a targeted search of ClinicalTrials.gov . RESULTS: Two hundred thirty-four primary studies and three SRs were eligible for abstraction. We grouped studies into focused areas of research: maternal health (n = 96), prevention (n = 46), disease management (n = 63), family planning (n = 9), high-risk breast cancer assessment (n = 10), intimate partner violence (n = 7), and mental health (n = 3). Most interventions focused on phone as the primary telehealth modality and featured healthcare team-to-patient communication and were limited in duration (e.g., < 12 weeks). Few interventions were conducted with older women (≥ 60 years) or in racially/ethnically diverse populations. There are few SRs in this area and limited evidence regarding newer telehealth modalities such as mobile-based applications or short message service/texting. Targeted search of clinical.trials.gov yielded 73 ongoing studies that show a shift in the use of non-telephone modalities. DISCUSSION: Our systematic evidence map highlights gaps in the existing literature, such as a lack of studies in key women's health areas (intimate partner violence, mental health), and a dearth of relevant SRs. With few existing SRs in this literature, there is an opportunity for examining effects, efficiency, and acceptability across studies to inform efforts at implementing telehealth for women.

Exploring the factor structure of a battery of neuropsychological assessments among the CENC cohort.

OBJECTIVE: The goal of the Chronic Effects of Neurotrauma Consortium (CENC) study is to explore the effects of concussions among Service Members and Veterans. A factor model was fit to selected neuropsychological measures to identify potentially useful relationships between assessments collected on CENC-enrolled participants. METHOD: 492 post-9/11 participants with combat exposure were enrolled across four VA study sites. Participants completed assessments including concussion history, neurocognitive functioning, and self-report questionnaires. Exploratory factor analyses (EFA) using four different methods with varimax and promax rotations were used to analyse the cognitive variables. Final model selection was based on factor loadings towards simple structure. RESULTS: The scree plot suggested the number of factors to be extracted was between 4 and 5. EFA produced a 5-factor MINRES model with promax rotation that resulted in a factor loading with variables loading on only one factor with a predefined threshold (0.40). Variables loaded on five cognition domains: list learning, working memory/executive skills, cognitive control, fluency, and memory. CONCLUSION: These results provide reasonable evidence that data collected from the CENC neuropsychological battery can be reduced to five clinically useful factors. This will enable us to use the factors for further study of the impact of concussion on neurodegeneration.

Chronic Effects of Neurotrauma Consortium (CENC) multicentre study interim analysis: Differences between participants with positive versus negative mild TBI histories.

OBJECTIVES: Compare characteristics and outcomes of combat-exposed military personnel with positive versus negative mild traumatic brain injury (mTBI) histories. SETTING: Recruitment was from registration lists and ambulatory clinics at four veterans administration hospitals. PARTICIPANTS: Consented veterans and service members completing initial evaluation by September 2016 (n = 492). DESIGN: Observational with cross-sectional analyses. MAIN MEASURES: Multimodal assessments including structured interviews, record review, questionnaires, neuroendocrine labs and neurocognitive and sensorimotor performance. RESULTS: In unadjusted comparisons to those absent lifetime mTBI, the mTBI positive group (84%) had greater combat exposure, more potential concussive events, less social support and more comorbidities, including asthma, sleeping problems and post-traumatic stress disorder. They also fared worse on all sensory and pain symptom scores and self-reported functional and global outcomes. They had poorer scores on Wechsler Adult Intelligence Scale-IV coding (processing speed), TMT-B (visual-motor integration and executive function) and two posturography subtests, but were otherwise equal to TBI negative participants on neurocognitive and sensorimotor testing and neuroendocrine levels. CONCLUSIONS: Although differences in characteristics exist which were not adjusted for, participants with historical mTBI have greater symptomatology and life functioning difficulties compared with non-TBI. Performance measures were less dissimilar between groups. These findings will guide further research within this accruing cohort.

RBANS Validity Indices: a Systematic Review and Meta-Analysis.

Neuropsychology practice organizations have highlighted the need for thorough evaluation of performance validity as part of the neuropsychological assessment process. Embedded validity indices are derived from existing measures and expand the scope of validity assessment. The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) is a brief instrument that quickly allows a clinician to assess a variety of cognitive domains. The RBANS also contains multiple embedded validity indicators. The purpose of this study was to synthesize the utility of those indicators to assess performance validity. A systematic search was completed, resulting in 11 studies for synthesis and 10 for meta-analysis. Data were synthesized on four indices and three subtests across samples of civilians, service members, and veterans. Sufficient data for meta-analysis were only available for the Effort Index, and related analyses indicated optimal cutoff scores of ≥1 (AUC = .86) and ≥ 3 (AUC = .85). However, outliers and heterogeneity were present indicating the importance of age and evaluation context. Overall, embedded validity indicators have shown adequate diagnostic accuracy across a variety of populations. Recommendations for interpreting these measures and future studies are provided.

Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis.

The purpose of the current systematic review and meta-analysis was to assess the effect of videoconference administration on adult neurocognitive tests. We investigated whether the scores acquired during a videoconference administration were different from those acquired during on-site administration. Relevant counterbalanced crossover studies were identified according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Twelve studies met criteria for analysis. Included samples consisted of healthy adults as well as those with psychiatric or neurocognitive disorders, with mean ages ranging from 34 to 88 years. Heterogenous data precluded the interpretation of a summary effect for videoconference administration. Studies including particpants with a mean age of 65-75, as well as studies that utilized a high speed network connection, indicated consistent performance across videoconference and on-site conditions, however studies with older participants and slower connections were more variable. Subgroup analyses indicated that videoconference scores for untimed tasks and those allowing for repetition fell 1/10th of a standard deviation below on-site scores. Test specific analyses indicated that verbally-mediated tasks including digit span, verbal fluency, and list learning were not affected by videoconference administration. Scores for the Boston Naming Test fell 1/10th of a standard deviation below on-site scores. Heterogenous data precluded meaningful interpretation of tasks with a motor component. The administration of verbally-mediated tasks by qualified professionals using existing norms was supported, and the use of visually-dependent tasks may also be considered. Variability in previous studies indicates a need for further investigation of motor-dependent tasks. We recommend the development of clinical best practices for conducting neuropsychological assessments via videoconference, and advocate for reimbursement structures that allow consumers to benefit from the increased access, convenience, and cost-savings that remote assessment provides.

Evaluating the motor slowing hypothesis of depression.

The purpose of this study was to evaluate the hypothesis that processing speed deficits are the primary cognitive deficits in those with depression, consistent with the motor slowing hypothesis. Participants (n=223) were research volunteers who served in the US military since September 11, 2001, and denied a history of significant brain injuries. Depression was measured using a structured interview, the Personality Assessment Inventory (PAI), and the Beck Depression Inventory-II (BDI-II). Outcomes included performance on 10 processing speed variables. Invalid performance/report accounted for significant variance for 8 of 10 processing speed measures. There was not a consistent pattern of slowed processing speed in those with current depressive diagnoses compared to those without. However, depression symptom burden per the PAI Depression scale was significant for 7 of 10 processing speed tests. Only non-dominant fine motor dexterity was significantly slower in those with high versus low burden using BDI-II quartiles. Thus, the motor slowing hypothesis was supported, but only for depression burden and not diagnostic status or high versus low categorical classification. These results underscore the importance of validity assessment and consideration of how one measures psychiatric constructs when evaluating relations among symptoms and cognition.

Word Memory Test Performance Across Cognitive Domains, Psychiatric Presentations, and Mild Traumatic Brain Injury.

OBJECTIVE: The current study addressed two aims: (i) determine how Word Memory Test (WMT) performance relates to test performance across numerous cognitive domains and (ii) evaluate how current psychiatric disorders or mild traumatic brain injury (mTBI) history affects performance on the WMT after excluding participants with poor symptom validity. METHOD: Participants were 235 Iraq and Afghanistan-era veterans (Mage = 35.5) who completed a comprehensive neuropsychological battery. Participants were divided into two groups based on WMT performance (Pass = 193, Fail = 42). Tests were grouped into cognitive domains and an average z-score was calculated for each domain. RESULTS: Significant differences were found between those who passed and those who failed the WMT on the memory, attention, executive function, and motor output domain z-scores. WMT failure was associated with a larger performance decrement in the memory domain than the sensation or visuospatial-construction domains. Participants with a current psychiatric diagnosis or mTBI history were significantly more likely to fail the WMT, even after removing participants with poor symptom validity. CONCLUSIONS: Results suggest that the WMT is most appropriate for assessing validity in the domains of attention, executive function, motor output and memory, with little relationship to performance in domains of sensation or visuospatial-construction. Comprehensive cognitive batteries would benefit from inclusion of additional performance validity tests in these domains. Additionally, symptom validity did not explain higher rates of WMT failure in individuals with a current psychiatric diagnosis or mTBI history. Further research is needed to better understand how these conditions may affect WMT performance.